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The rapid response system (RRS) is an innovative system designed for in-hospital, at-risk 
patients but underutilization of the RRS generally results in unexpected cardiopulmonary 
arrests. We implemented an extended RRS (E-RRS) that was triggered by actively screening 
at-risk patients prior to calls from primary medical attendants. These patients were 
identified from laboratory data, emergency consults, and step-down units. A four- 
member rapid response team was assembled that included an ICU staff, and the team 
visited the patients more than twice per day for evaluation, triage, and treatment of the 
patients with evidence of acute physiological decline. The goal was to provide this 
treatment before the team received a call from the patient's primary physician. We sought 
to describe the effectiveness of the E-RRS at preventing sudden and unexpected arrests 
and in-hospital mortality. Over the 1-yr intervention period, 2,722 patients were screened 
by the E-RRS program from 28,661 admissions. There were a total of 1 ,996 E-RRS 
activations of simple consultations for invasive procedures. After E-RRS implementation, 
the mean hospital code rate decreased by 31 . 1 % and the mean in-hospital mortality rate 
was reduced by 1 5.3%. In conclusion, the implementation of E-RRS is associated with a 
reduction in the in-hospital code and mortality rates. 

Keywords: Rapid Response System; Implementation; Extended RRS; At-Risk Patient; 
Death, Sudden, Cardiac; Mortality 



INTRODUCTION 

'At-risk patients' (also called 'high-risk patients') are patients 
who face a disparity between their medical needs and the avail- 
able hospital resources (1). This disparity is often at the root of 
sudden cardiac arrest and mortality, and it occurs in up to 10% 
of in-hospital emergency patients who require urgent critical 
care (2-4). One of the main reasons for this disparity is an insuf- 
ficient early detection system for at-risk patients, and because 
of this insufficiency, delayed decision-making often occurs (5). 
Critical physiological changes, such as unstable vital signs or 
altered mental status, have been reported in up to 80% of pa- 
tients who have experienced an arrest, and these are often seen 
six to eight hours before the arrest occurs (5-10). However, in 
many cases, doctors and nurses overlook these warning signs 
(2). Detection is the first step in treatment, and approximately 
37% of these events might have been prevented if a simple cri- 
terion were monitored, such as abnormal vital signs or altered 
mental status (e.g., a change from being alert to having slurred 
speech or becoming delirious or comatose) (4-6). Additionally 
it has been reported that the prevention of unexpected clinical 
deterioration in critically ill patients could be achieved by the 
simple identification of the warning signs associated with a change 



in critical vital signs (11). 

A rapid response system (RRS), which has also been called a 
medical emergency team (MET), a rapid response team (RRT), 
or a critical care outreach (CCO) team, is an innovative system 
for identifying at-risk patients and saving their lives in general 
wards. The system identifies at-risk patients before respiratory 
system, circulatory system, or multi-system organ dysfunction 
occurs, thus avoiding an intensive care unit (ICU) admission or 
even preventing cardiac arrest (12-14). Previous studies have 
identified many types of RRSs that are effective at decreasing 
cases of in-hospital mortality, although, most models focused 
on urgent actions in response to calls by a primary medical team. 
The underutilization of RRSs is widespread, and delays in re- 
questing the RRS team occur in up to 30% of hospitals (15). To 
reduce the underutilization, one group worked with nurses to 
help them distinguish 'worry' from 'general concern' when ma- 
king clinical judgments (16), and another group tried imple- 
menting a broad system that would allow family or patients 
themselves to initiated the RRS team (17). Despite these trials, 
many RRSs have a low utilization rate due to primary medical 
teams not calling the RRS despite criteria for activation being 
met (18). Unfortunately, patients who experienced a delayed 
RRS call have been shown to have a markedly increased mor- 



© 2014 The Korean Academy of Medical Sciences. 

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.0rg/licenses/by-nc/3.o) 
which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. 



pISSN 1011-8934 
elSSN 1598-6357 



JKMS 



Kwak HJ, et al. • The Extended Rapid Response System 



tality rate compared with those who received a timely call (19- 
23). More at-risk patients could be saved if an RRS is triggered 
in a more active and automatic manner. To overcome this limi- 
tation of lower utilization, we developed an extended RRS that 
includes sensitive screening tools and active triggering system 
before calls from the primary medical team are made. However, 
until now, most models of RRSs have focused on increasing the 
number of calls from a primary medical team or initiating ur- 
gent actions to the calls. 

The Hanyang RRT (HaRRT) is an extended rapid response 
system (E-RRS) at the Hanyang University Hospital. The E-RRS 
differed from the previous RRS in that it did not depend on calls 
from primary medical members and it searched for at-risk pa- 
tients before the calls were made. We also visited all of the screen- 
ed at-risk patients and performed some consultations in critical 
situations prior to the standard medical respirology, cardiology, 
and nephrology consultations. Our aim was to demonstrate the 
effectiveness of E-RRS at decreasing unexpected cardiopulmo- 
nary arrests. Here, we report the successful first year of this E- 
RRS. 

MATERIALS AND METHODS 
Study design and hospital 

This was a prospective, observational study performed at Han- 
yang University Hospital, an 813-bed tertiary care teaching hos- 
pital in Seoul, Korea. At the time of the study, this hospital con- 
tained a full complement of heart, solid organ, and bone mar- 
row transplant services for adults and children, surgery pro- 
grams, and medical and surgical sub-specialty services. When 
the study was conducted, approximately 28,700 patients per 
year were admitted to this hospital. The hospital also contains 
45 intensive care unit (ICU) beds (16 medical, 15 surgical, and 
14 pediatric ICU). 

Prior to implementation of the E-RRS, staff education was 
performed from September 1 to December 31, 2011; and the E- 
RRS program rollout was completed by December 19, 2011. In 
this study, we included admitted patients who were 18 yr of age 



or older between January 1 and December 31, 2012. If a mem- 
ber of the primary staff asked for pediatric patients to be man- 
aged, we also included them for monitoring and urgent care 
management. We collected patient data during the year follow- 
ing E-RRS implementation, and we collected the results of sud- 
den arrests occurring in patients over a two-year period. This 
2-yr period included the year prior to and the year following E- 
RRS implementation, which took place from January 1, 2011 to 
December 31, 2012. 

The E-RRS organization 

The E-RRS included a respirology staff member as an intensiv- 
ist (n = 1), an interventional cardiologist (n = 1), one internal 
medicine resident (1 day and 1 night duty), and an experienced 
ICU nurse who was exclusively responsible for the team (n = 1). 
The staff members were available from 07:00 until 20:00. After 
hours, the night-duty resident was available, and if an addition- 
al decision was needed, he or she could call the remainder of 
the staff at any time; therefore, the effective coverage period 
was 24 hr per day. 

To define the meaning of 'at-risk patients,' we modified the E- 
RRS criteria using the triggering criteria from previous studies 
(4, 6, 8, 10-13, 19, 22-25). Our definition included not only crite- 
ria related to abnormal vital signs, but it also contained critical 
symptoms, such as stridor, chest pain, altered mental status, 
and abnormal laboratory findings. The criteria were posted in 
the form of a yellow poster that was displayed prominently in 
each ward (25 sites). Specifically, if any of the conditions in the 
posted criteria were present, the staff members were instructed 
to call a cellular phone that was exclusive to the E-RRS. The E- 
RRS criteria are shown in Table 1. 

Promotional and educational strategies 

We presented the outline of the E-RRS three times for the chiefs 
of all medical and surgical departments and one time for each 
department of internal medicine, orthopedics, general surgery, 
obstetrics and gynecology, and urology. We also introduced 
screening and early management of high-risk patients to nurses 



Table 1. The extended rapid response system (E-RRS) criteria for 'at-risk patients' 

Clinical manifestations 
Stridor: sign of an upper airway obstruction 
Chest pain: severe anterior chest or epigastric pain with sweating 

Altered mentality: altered character and/or depth of mentality (e.g., confusion, delirium, drowsiness, stupor, semi-coma, or coma) 
Vital signs 

Heart rate: an acute change in the heart rate to < 50 beats/ min or > 130 beats/min 
Respiratory rate: an acute change in the respiratory rate to < 8 breaths/ min or > 25 breaths/min 
Shock: an acute change in the systolic blood pressure to < 90 mmHg or a mean pressure < 60 mmHg 
Laboratory findings 

A blood gas profile of pH < 7.30 or PaC0 2 > 50 mmHg or Pa02 < 55 mmHg 
Lactate > 2.0 mM/L 

Serum glucose < 50 mg/dL with an abnormal mentality 
A staff member was concerned about the patient (only concerned but not included in other criteria) 
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in each hospital wards (23 wards) for three times (69 education 
sessions over 3 months). We twice held conferences about the 
management of at-risk patients (shock, mental change, chest 
pain, and respiratory failure) for all staff of the medical center. 
All new hires at the medical center were educated regarding the 
E-RRS. We placed yellow paper regarding the screening of high- 
risk patients and an introduction to the E-RRS on the wall for 
medical personnel and patients. We also wore yellow work clo- 
thes for the initial 3-month period after implementation. When 
we screened at-risk patients, we provided consultations to pri- 
mary medical personnel (doctors and nurses) directly and in 
written form with a computerized order communication sys- 
tem (OCS). We also found and reported some medical errors 
such as inappropriate oxygen supply, uncharged infusion pump 
of main vasopressor, and missing alarms of critical vital signs of 
patients in step-down units to the department of Quality Im- 
provement (Q.I.). We created hot lines for nurses in each gener- 
al ward, called 'Ward Saver.' After implementation, we educated 
them every month and they delivered the contents to their wards. 

The E-RRS intervention 

In contrast to previous RRS teams, we screened high-risk pa- 
tients before we received calls from the patient's primary team. 
This was achieved by cardiology and pulmonology consulta- 
tions. We also used computerized alerts of abnormal laboratory 
findings by evaluating abnormal laboratory data from the clini- 
copathology department (critical value result, CVR). We moni- 
tored the patients in a treatment room (step-down unit) of each 
ward and closely observed patients as they transitioned from 



the ICU to the general ward. Even if patients were flagged as 
high risk for a major operation but had normal vital signs and 
laboratory findings, we monitored them for one day before the 
operation and followed them for more than 2 days after the op- 
eration. E-RRS staff had regular rounds more than twice per 
day and evaluated patients every day (Table 2). 

When activated, an E-RRS team was expected to arrive with- 
in 3 min, complete patient assessments within 15 min, and or- 
der diagnostic tests and therapeutic treatments that were perti- 
nent to the patient's condition. In addition, management of the 
evaluation was discussed with the patient's primary medical 
personnel, and the need for more intensive monitoring or the 
establishment of a 'do-not-resuscitate (DNR)' status was deter- 
mined as appropriate. 

The E-RRS team was equipped with an emergency pack con- 
taining the drugs and equipment needed for resuscitation and 
endotracheal intubation. After an E-RRS call, if the patient was 
not admitted to the ICU, then a regular medical round for the 
patient was performed twice per day until the patient crisis was 
resolved. At this time, the E-RRS visit was considered a formal 
consultation, and when the parent unit was contacted, any con- 
cerns, advice, and suggestions were verbally communicated 
and recorded on the patient's chart. For this process, we opened 
an independent computerized report system for sharing pa- 
tients' information; this included the reasons for close patient 
observation, the actions taken during this observation period, 
and specific symptoms and signs exhibited by the patient that 
necessitated a call to the team (from October 1, 2012). 



Table 2. Engagement of the extended rapid response system (E-RRS): four components of the E-RRS 



Step of action 



Engagement 



1 . Afferent limb (Screening 
for 'at-risk patients') 



2. Efferent limb (Action) 



3. Feedback 



Patients who are treated in step-down units 

Patients who are treated with a high level of oxygen therapy (venture mask > 35%, 9L) 

Patients who present with dyspnea, chest pain, hypoxia, severe pneumonia, pulmonary congestion, or ARDS with an emergent consultation by 
cardiology and respirology 

Patients defined as 'high-risk patients' for a major operation by consultation with cardiology and respirology 
Patients with abnormal laboratory findings (CVR* from clinicopathology department) 
Patients who are over 85 yr old 
On-calls from the primary physician 
Regular action: Regular rounding and conferences per 1 2 hr 
Emergent action: On-call visits from primary physicians in the general wards 
Emergent management: procedures and consultation 
Review of all patient cases every week 
Feedback paper for each ward and department 
Review of all cases of sudden cardiac arrests every month 
Conferences with the head of the Q.I. department, general ward and ICUs 
Run a Facebook site 

Regularly report the number of actions, types of actions, and the outcomes 

Reward to the best department who called the earliest and managed the patients adequately until the E-RRS arrived 
Education for 'at-risk patients'; patient safety, the E-RRS call criteria and initial managements for these patients (chest pain, respiratory failure, 

shock, and mental changes) for each ward and each department 
The number of training sessions over 1 yr was 79 

*CVR, critical value results: composed of abnormal results of electrolytes, blood gas profile, and glucose results, which were discussed with the Department of Clinicopathology, 
the Q.I. department and the E-RRS. The criteria of the CVR were revised three times to achieve a higher sensitivity of screening. E-RRS, extended rapid response system; ARDS, 
acute respiratory distress syndrome; CVR, critical value results; Q.I., quality improvement; ICU, intensive care unit. 
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Feedback 

We reviewed all the screened patients every week and held con- 
ferences each month to report monthly results (incidence of 
unexpected arrest and the analysis of related factors) to the chief 
of the department of Q.I., the hospital president, head nurses of 
the general wards and intensive care units, and the chief of the 
'Risk Management Team (RMT).' We prepared questionnaires 
to assess the satisfaction with the education sessions and ac- 
tions of the E-RRS (feedback was given monthly and after every 
education session), and we also created a Facebook site (https: 
//www.facebook.com/withHaRRT) to collect feedback. We re- 
gularly reported the number of actions, the types of actions and 
the results. With the Department of Medical Information Sys- 
tems, we developed independent electronic medical records 
for the E-RRS in OCS. We wrote newsletters every 6 months to 
report the outcomes of the implemented actions. 

Study outcomes 

The primary outcomes were in-hospital cardiopulmonary ar- 
rest rate per 1,000 admissions without a pre-existing do not re- 
suscitation (DNR) order and mortality rate per 100 discharges. 
A code was defined as any patient with an unexpected cardiac 
or respiratory arrest requiring resuscitation, with or without the 
activation of a hospital- wide alert. Cardiac arrests were defined 
as the cessation of cardiac activity determined by the absence 
of a palpable pulse. In addition, patients requiring life-saving 
cardiac compression or emergency resuscitation were consid- 
ered to have had a cardiac arrest. Respiratory arrest was defined 
as apnea and unresponsiveness. The data on the primary rea- 
son for a rapid response team activation, rapid response team 
interventions, and disposition of patients after a rapid response 
team evaluation were also prospectively collected. 

Statistical analysis 

The data were analyzed using SPSS software, version 19.0. Con- 
tinuous variables were expressed as the mean ± standard devi- 
ation or the median ± the interquartile range. The study vari- 
ables were compared with a chi-square test. A multiple logistic 
regression analysis was used to evaluate the adjusted trends in 
the outcome variables throughout the study period. A modified 
early warning score (MEWS) was used to reflect the initial sta- 
tus of the screened patients. This variable was selected accord- 
ing to previous reports on screening at-risk patients (24-26). 
Continuous variables were tested using a two-tailed t-test for 
independent samples. 

Ethics statement 

We obtained approval from the institutional review board of 
Hanyang University Medical Center to implement the HaRRT 
and collect data related to the study. 



RESULTS 

Baseline patient characteristics 

We screened 2,722 at-risk patients among all patients who were 
hospitalized over a one-year period. Of these patients, 1,996 
were treated with interventions including emergency consulta- 
tions, procedures (e.g., intubation, C-line insertion and early 
goal- directed therapy) and ICU arrangements, and the rest were 
closely observed without actions. The mean patient age was 
64.5 ± 15.8 (13- 101) yr, and the number ofmales was 1,368(51.0%). 
The baseline characteristics of the subjects are shown in Table 
3. Most of the subjects were patients in step-down unit or were 
at-risk patients who were automatically identified by an emer- 
gent cardiology or respiratory consultation (n = 2,302, 84.6%). 
Other patients were identified following calls from primary phy- 
sicians (n = 234, 8.6%), abnormal laboratory findings (CVR, 
n = 141, 5.2%), or those deemed to be at high risk for a major 
operation (n = 70, 2.6%) as determined by the Department of 



Table 3. Baseline characteristics of all patients screened by the extended rapid re- 
sponse system (E-RRS) and the interventions they received 



Characteristics 


Findings (n = 2,722) 


Male, No. (%) 


1,386 (51.0) 


Age (yr) 


64.5 + 15.8 


BMI (kg/m 2 ) 


23.2 + 7.6 


Surgical patients, No. (%) 


1 ,321 (48.5) 


Postoperative care patients, No. (%) 


173(6.4) 


Post-operation days (days) 


5.8 + 9.1 


Post-ICU care (days) 


251 (9.2) 


Mean hospital days (days) 


10.6 + 14.2 


Duration of treatment in step-down unit (days) 


1.65 + 0.8 


Shock, SBP < 80, No. (%) 


43 (1 .6) 


Hypoxia or type 1 respiratory failure, No. (%) 


127(4.7) 


Respiratory failure (II and IV), No. (%) 


51 (1.9) 


Chest pain or bradycardia, No. (%) 


23 (0.8) 


Altered mental status including confusion, No. (%) 


153(5.6) 


Mean MEWS 


1.5 + 1.3 


Interventions 
Consultation*, No. (%) 
Monitoring vital signs only, No. (%) 
Oxygen supplement and manipulation 1 , No. (%) 
DNR, No. (%) 
Advanced procedures 
ICU arrangement, No. (%) 
Intubation, No. (%) 

Early goal-directed therapy (EGDT), No. (%) 

C-line insertion, No. (%) 

Defibrillators or external pacing, No. (%) 


1 ,996 (73.3) 
726 (26.7) 
334 (12.3) 
57(2.1) 
470 procedures in 432 cases 
167(6.1) 
132(4.8) 
118(4.3) 
46 (1 .7) 
7 (0.3) 



Values are mean value + standard deviation. Note that some cases required multiple 
actions (e.g., patients with septic shock due to pneumonia required multiple proce- 
dures such as intubation, C-line insertion, EGDT, oxygen supplement and ICU ar- 
rangement). 'Emergent consultation before regular consultation including correcting 
electrolyte imbalance, early use of antibiotics, early anticoagulation for pulmonary 
thromboembolism, correcting fluid overload, dehydration and treatment of pulmonary 
congestion, ventilator care of patients with amyotrophic lateral sclerosis, and treat- 
ment of arrhythmia (using defibrillator or medication). Including low-flow oxygen 
supplement and high-flow nasal oxygen therapy. BMI, body mass index; ICU, inten- 
sive care unit; SBP, systolic blood pressure; MEWS, modified early warning score; 
DNR, do not resuscitate; C-line, central venous line. 
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Anesthesia. Many of these patients had more than one cause 
for screening. There were 1,388 of screened patients who had 
symptoms and signs that met the call criteria (51.0%), but only 
16.5% of them were reported to the E-RRS by calls from the pri- 
mary physician (Table 4). Abnormal heart rate, elevated respi- 
ratory rate, and hypoxia were the most common signs that met 
the E-RRS criteria, and approximately 32.3% of patients exhibit- 
ing these signs required advanced procedures; however, only 
17.9% of them were reported to the E-RRS. The patients with 
abnormal laboratory findings of low pH, high lactate level, or 
electrolyte imbalances were not reported to the E-RRS, even if 
they required advanced procedures after screening (Table 4). 
Calls from the primary ward doctor were more surgical in na- 
ture (surgical vs medical, 3.7% vs 3.3%, respectively, P = 0.041). 
Surgical patients were also younger (63.0 ± 16.0 vs 65.7 ± 15.4 
yr, P - 0.027), and they had a lower MEWS than medical patients 
(1.49 ± 1.12 vs 1.79 ± 1.37, P < 0.001). 

The E-RRS procedures 

The E-RRS team initiated and completed a variety of investiga- 
tive, preventive and therapeutic procedures. An E-RRS response 
was ttiggered not only by an emergency call from primary me- 
dical personnel but also if the patient needed emergency man- 
agement after evaluation by E-RRS staff. We also performed 
emergency consultations prior to regular consultations, which 



included correcting an electrolyte and fluid imbalance, early 
use of antibiotics, early anticoagulation treatment for a pulmo- 
nary thromboembolism, tteatment of pulmonary congestion, 
ventilator care of patients with amyotrophic lateral sclerosis, 
treatment of arrhythmia (using a defibrillator or medication for 
PSVT, atrial fibrillation, and bradycardia), and emergency car- 
diology consultation via a hotline. Some cases required multi- 
ple actions (for example, septic shock due to pneumonia, intu- 
bation, C-line insertion, early goal-directed therapy, oxygen sup- 
plementation and ICU arrangements). An outline of these pro- 
cedures is shown in Table 3. Advanced managements such as 
intubation, C-line insertion, early goal-directed therapy (EGDT) 
and ICU arrangements were performed in 16.9% of screened 
cases (Table 4). Hypoxia was the most common reason we were 
called, and 30.5% of these patients required an advanced pro- 
cedure such as intubation or ICU care. For patients with chest 
pain, shock and altered mentality, half required advanced pro- 
cedures, but the call rate was not high among these patients 
(Table 4). 

Outcomes 

After E-RRS implementation, the mean hospital code rate de- 
creased from 5.66 to 3.90 per 1,000 admissions. This represents 
a 31.1% decrease in sudden deaths compared with the pre-im- 
plementation period. The in-hospital mortality rate was also re- 



Table 4. Main interventions by the extended rapid response system (E-RRS) 



Screening criteria 


Reported cases Calls from primary physician (% of all reported 
(No.) cases) due to the screening criteria 


Cases that triggered advanced management 
(%) of all reported cases 


E-RRS call criteria 








Stridor or dyspnea 


37 


1 1 (29.7) 


15(40.5) 


Chest pain 


23 


18(78.3) 


11 (47.8) 


Altered mentality (including delirium) 


53 


16(30.2) 


42 (79.2) 


Heart rate > 1 30 beats/min or < 50 beats/min 


178 


14(7.9) 


53 (29.8) 


Respiratory rate > 25 breaths/min 


128 


3 (2.3) 


49 (38.3) 


SBP < 90 mmHg 


67 


17(25.4)* 


46 (68.7)* 


pH < 7.30+ 


79 


0(0)' 


58 (73.4)* 


pC0 2 > 50 mmHg* 


116 


25(21.6) 


51 (44.0)* 


pa0 2 < 55 mmHg* 


174 


65 (37.4) 


53(30.5) 


Lactate > 2.0 mM/L* 


77 


0(0)' 


27 (35.1) 


Glucose < 50 mg/dL* 


14 


1 (25.0) 


4 (22.2) 


Only concerned (not included in other criteria) 


19 


2 (3.4) 


4(21.1) 


Others 
Electrolyte imbalance 
Perioperative observation (high risk) 
Post-ICU care 


77 

173 
173 


0 (0.0)' 
52 (30.1) § 
5 (2.9) 


13(16.9) 
39 (22.5) 
28 (16.2) 



"Reported cases" mean symptoms or signs that were found when patients were screened for all causes. "Calls from primary physician" means a call from the primary physi- 
cian due to the screening criteria (symptoms or signs). "Cases that triggered advanced management" means actions that triggered advanced managements such as intubation, 
C-line insertion, EGDT, ICU arrangement, or supplementation with high-flow nasal oxygen therapy. For example, a patient was screened due to 'mental change', but we also 
found shock and chest pain at the same time, and intubation and C-line insertion was performed; the "reported cases" included three items (mental change, shock, and chest 
pain). The "calls from primary physician" is 'mental change' only, and "triggered advances management" is intubation and C-line insertion (2 items). *AII cases of 'call from pri- 
mary physician' is reported as systolic blood pressure < 70 mmHg. *We set up the 'critical value results from the clinicopathology department' in August 2012, and the criteria 
were modified twice in December 201 2 and in December 201 3. The data were collected for only half of the year. *Many of cases had more than two overlapping criteria. Twen- 
ty-four of these patients had more than two laboratory findings that fell under the E-RRS criteria. § Patients undergoing operation under general anesthesia who were deemed 
high-risk were screened with consultations from cardiology and respirology (from January 201 2), as well as daily calls from the Department of Anesthesiology (from August 
201 2). "There were no calls related to abnormal findings of pH, lactate, or electrolyte imbalances. These findings were from critical value results of the clinicopathology depart- 
ment. ICU, intensive care unit; SBP, systolic blood pressure; EGDT, early goal-directed therapy; C-line, central venous line. 
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Table 5. Outcomes of the extended rapid response system (E-RRS) implementation 



Basline pre-HaRRT period 



Number of sudden a 
Mean number of sudden arrests 



Fig. 1. Change in sudden arrest rates after E-RRS implementation (number of sud- 
den arrests per 1,000 admissions). After E-RRS implementation, the mean hospital 
code rate decreased from 5.66 to 3.90 per 1 ,000 admissions and resulted in a sub- 
stantial decrease in sudden death of 31 .1 % compared with the previous year. J-F, 
from January to February; M-A, from March to April; M-J, from May to June; J-A, 
from July to August; S-O, from September to October; N-D, from November to De- 
cember. HaRRT, Hanyang Rapid Response Team 

duced by 15.3%, from 1.63 to 1.38 per 100 discharges (Fig. 1). 

Of the 1,321 surgical patients, 19 patients (including 10 DNR- 
patients) died; 34 of the 1,440 medical patients (including 11 
DNR-patients) died. Lower mortality was observed in surgical 
patients (mortality in surgical patients vs medical patients was, 
1.4% vs 2.4%, respectively), but this difference was not significant 
after it was adjusted for age, sex, or patient MEWS {P = 0.466). 

Despite the E-RRS intervention, 49 patients died. In addition, 
32 of these patients were not treated intensively and their sur- 
rogates signed a DNR permission document. The other 17 car- 
diac arrests that occurred during the E-RRS intervention devel- 
oped due to acute myocardial infarction (n = 3), respiratory 
failure (n = 4), septic shock (n = 8), or a postoperative compli- 
cation (n = 2). The outcomes are shown in Table 5. The rate of 
arrests due to respiratory failure was significantly reduced after 
E-RRS implementation (47.8% vs 33.3%, P = 0.046), but shock 
and cardiac arrest rates did not change. Among surgical patients, 
the number of arrests declined (13 cases vs 10 cases), but this 
finding was not statistically significant {P = 0.333). 

DISCUSSION 

This is the first report in Korea describing the implementation 
of an E-RRS triggered and activated automatically before calls 
from the primary medical attendants in an 813-bed university 
hospital. The implementation of the E-RRS significantly decre- 
ased the incidence of all-cause sudden arrest by 31.1%, and it 
was particularly effective at reducing the rate of arrests due to 
respiratory failure. The intervention may also be associated with 
a decline in the in-hospital mortality rate. Importantly, this sys- 



Outcomes 


No. (%) of cases 


Outcomes of screened patients 


2,722 


Survival to discharge 


2,673 (98.2) 


Death despite E-RRS intervention 


49 (1 .8) 


Before ICU transfer 


9(18.4) 


After ICU transfer 


8(16.2) 


DNR decision 


32 (65.3) 


Overall cardiac arrest in the entire hospital 


n = 95 


In general wards 


47 (49.5) 


Sudden cardiac arrest without E-RRS intervention 


22 (23.2) 



E-RRS, the extended rapid response system; ICU, intensive care unit; DNR, do not re- 
suscitate. 



tem worked with only four E-RRS team members, including an 
intensivist, and devices for airway management. Furthermore, 
these results were achieved without more extensive investigation. 

The literature on the results of previous RRSs reveals variable 
success in reducing sudden arrests and mortality. This variation 
may be explained by the unexpected variances in the baseline 
events rates, short observational periods, and differences be- 
tween the types of RRS (nurse-led vs. doctor-led teams) (27-29). 
Screening is the first step in triggering an RRS, but there are many 
barriers to calling an RRS team to care for at-risk patients, such 
as disengagement between the doctors and nurses, profession- 
al resistance, and inadequate knowledge for recognizing at-risk 
patients (1). In previous studies, 20%-25% of patients at risk were 
not identified due to insufficient recognition of the patient warn- 
ing signs by doctors and nurses (5, 6). It has been reported that 
3.7%-4.0% of hospitalized patients show critical symptoms and 
signs and that the rate of adverse events due to negligence is 
0.8%-1.0%. A delay in making an RRS call is a problem; it has 
been reported that approximately 30% of patients at risk had a 
delay between the presentation of critical signs and when the 
call was made (15), with a mean delay of > 13 hr (22). Many of 
these delays were associated with an increase in patient mortal- 
ity or morbidity rates (7, 22). Continuous education and aware- 
ness are solutions to this problem, but these measures also have 
limitations, including low perception rates and the underuti- 
lization of RRSs (20, 21, 23). 

We attempted to overcome this screening limitation in our 
RRS through an early screening protocol. The mean modified 
early warning score (MEWS) in this study was 1.5 ± 1.3 com- 
pared with scores of more than 2.0 in other studies that relied 
on calls from primary medical attendants. We also established 
regular rounds to monitor the screened patients, directed the 
alarm for abnormal laboratory findings, and conducted emer- 
gency call training for emergency primary medical attendants. 
This E-RRS was effective despite the short implementation and 
brief intervention periods. Advanced procedures such as intu- 
bation, C-line insertion, early goal-directed therapy and ICU 
arrangements, occurred in 16.9% of cases. We screened a total 
number of 5.9 times of these patients, and approximately 80% 
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of screened patients needed only consultation and monitoring 
of vital signs. Someone could criticize this as the squandering 
of the hospital's resources. However, the aim of study was to 
save as many at-risk patients as possible using limited resources 
by enrolling these patients in the E-RRS, which overcame limi- 
tations of a previous RRS that depended on calls, and we strove 
to find the maximum efficiency with the minimum resources. 
It may be an endeavor to develop a complete system as part of 
a patient safety initiative, and this study could provide elemen- 
tary data for further trials. 

Despite our efforts, we missed 22 at-risk patients during the 
year following E-RRS implementation, and 16 (72.7%) of these 
patients died after long cardiopulmonary resuscitations. Twelve 
of these patients experienced respiratory failure with metabolic 
acidosis, with or without septic shock, and 4 patients had sud- 
den myocardial infarctions. This omission of at-risk patients re- 
vealed the limitation of our screening, and we should develop 
further screening tools for at-risk patients. To ameliorate the 
weak points in our RRS, we have tried to continuously screen 
the patients with greater regular rounding, regular RRS educa- 
tion, and small discussion groups about patient safely, and we 
also developed the in-hospital network services including a 
computerized alert. 

There were more calls from the primary ward doctors in sur- 
gical parts and the surgical patients showed younger age and 
lower MEWS than the medical patients. However, they did not 
show differences in mortality between surgical and medical 
parts. This means that the at-risk patients in the surgical depart- 
ment had less severe signs and lower MEWS than medical pa- 
tients, but experienced the same mortality. Thus, we expect that 
an E-RRS could be more effective at decreasing mortality among 
surgical patients than among medical patients, even if more 
minor symptoms and signs are incorporated to improve the E- 
RRS. 

The E-RRS decreased the rate of sudden arrest and mortality. 
However, these data are from one center, and there are many 
confounding factors such as changes in the hospital manage- 
ment policy and in the perception of patient safely, as well as 
the opening of a coronary care unit (CCU). The decline in mor- 
tality may have resulted from a decrease in the number of at- 
risk patients admitted in this year. There were no data on the 
number of high-risk patients in the past year. It is likely that the 
rate of at-risk patients did not decrease in this year because the 
turnover rate in the intensive care units increased from 103% in 
the previous year to 1 12% in the study year. At-risk patients who 
required intensive treatment were screened effectively by the E- 
RRS, which resulted in a higher turnover rate in the ICU. Before 
implementation of the E-RRS, spontaneous reporting from the 
primary physician was the only way to collect data on sudden 
arrest. These many serious omissions in the official records and 
the neglect of critical signs led to at-risk patients being missed. 



Regarding this, making and posting definitions of at-risk patients 
might be one effective method to promote and implement the 
E-RRS. 

There were few reports in the literature regarding computer- 
ized alert systems and the sharing of information. We designed 
the alert system to use critical values, and we also developed a 
new computerized chart for the E-RRS. With this, we could share 
the list of at-risk patients in real-time on ward computers, and 
the information provided a focus for management and an indi- 
cation to the primary physicians and nurses of when an emer- 
gency call was warranted. This may be the first trial to use tech- 
nology for the implementation of an E-RRS. 

In conclusion, we report the implementation of an E-RRS as- 
sociated with a reduction in hospital code and mortality rates 
over a short (one-year) observational period. A more active and 
automatic system could save more at-risk patients, and our de- 
sign could be considered as a pilot trial for other RRS studies. 
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